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SHIPIR  MODEL  VALIDATION  USING  NATO  SIMVEX  EXPERIMENT  RESULTS 


INTRODUCTION 

ShipIR  is  an  infrared  (IR)  ship  signature  prediction  model  that  has  been  adopted  hy  both  the  North 
Atlantic  Treaty  Organization  (NATO)  and  the  United  States  Navy  as  a  common  tool  for  predicting  the  IR 
signature  of  navy  ships  in  a  maritime  background.  Since  1993,  when  the  model  was  accepted  as  the  NATO 
standard,  a  series  of  model  upgrades  have  been  implemented  that  have  been  guided  by  comparison  with 
field  data.  The  results  of  a  preliminary  validation  of  a  previous  version  of  the  model  (Version  2.5)  were 
described  in  an  earlier  paper  [1].  A  NATO  science  panel.  Task  Group-16  (TG-16),  which  has  the  charter  to 
research  IR  ship  signature  issues,  has  recently  executed  a  field  trial  to  validate  the  latest  versions  of  the 
ShipIR  model  (Versions  2.9  and  3.0). 

ShipIR  is  a  model  that  simulates  the  IR  radiance  of  both  ship  targets  and  the  maritime  background.  It  is 
composed  of  several  major  submodels:  sky  radiance,  sea  radiance,  plume  radiance,  ship  temperature,  and 
ship  surface  emission/reflection. 

The  current  study  describes  the  results  of  a  validation  exercise  based  on  data  from  the  NATO  SIMVEX 
trial  (Shipjnfrared  Model  Validation  Experiment!.  This  trial  was  executed  specifically  for  IR  model  valida¬ 
tion;  its  design  was  based  on  the  collective  experience  of  the  NATO  TG-16  countries  from  each  of  their 
individual  validation  efforts.  The  participating  countries  (along  with  the  specific  organizations)  were:  Canada 
-  Defence  Research  and  Development  Canada  (DRDC)  and  Davis  Engineering;  Norway  -  Norwegian 
Defence  Research  Establishment  (EEI);  United  States  -  Naval  Research  Laboratory  (NRL);  The  Nether¬ 
lands  -  TNO  Physics  and  Electronics  Laboratory  (EEL);  Italy  -  Mariteleradar;  Erance  -  Centre  Technique  des 
Systemes  Navals  (CTSN);  Denmark  -  Danish  Defence  Research  Establishment  (DDRE);  and  Poland  -  Na¬ 
val  University  of  Gdynia. 

This  paper  summarizes  the  results  of  two  national  laboratories:  the  Naval  Research  Laboratory  (United 
States)  and  the  Norwegian  Defence  Research  Establishment  (Norway).  These  two  countries  were  the  first  to 
complete  their  analyses.  Comparisons  between  measured  and  predicted  signature  are  shown  for  both  ver¬ 
sions,  V2.9  and  V3.0,  of  ShipIR.  The  prediction  accuracy  of  the  model  is  quantified  in  both  the  mid-wave  IR 
(MWIR)  (3-5  pm)  and  long-wave  IR  (LWIR)  (8-12  pm)  spectral  bands,  and  errors  have  been  traced  to 
individual  submodels  for  subsequent  improvement. 

DESCRIPTION  OE  THE  SHIPIR  MODEL 

ShipIR  [1]  is  a  model  that  simulates  the  steady-state  IR  radiance  of  ship  targets  in  the  maritime  back¬ 
ground  (Pig.  1).  This  model  was  developed  by  Davis  Engineering  and  was  originally  funded  by  the  Cana¬ 
dian  Department  of  National  Defence,  through  the  Defence  Research  Establishment  Valcartier.  The  model  is 
composed  of  several  major  submodels:  an  IR  sky  radiance  and  propagation  model;  a  sea  reflectance  model; 
a  three-dimensional  (3D)  ship  surface  model,  which  enables  the  modeling  of  complex  ship  geometries;  a 


Manuscript  approved  January  20,  2004. 


1 


2 


Fraedrich,  Miller,  Stark,  and  Heen 


Fig.  1  — Typical  output  of  model  showing  the  various 
elements  of  sky,  sea,  ship,  and  plume 


heat  transfer  model;  a  surface  radiance  model,  capable  of  simulating  multibounce  reflections;  and  an  IR 
plume  model,  which  supports  predictions  of  both  diesel  and  gas  turbine  plume  radiance  profiles  (Fig.  2). 

The  3D  ship  surface  model  imports  a  DXF-formatted  CAD  file.  MODTRAN  4  is  used  to  compute  the 
radiance  distribution  of  the  sky.  Sea  radiance  is  computed  using  an  improved  version  of  a  sea  reflectance 
model  [2].  Fleat  transfer  is  modeled  by  accounting  for  conductive,  radiative,  and  convective  terms.  To  esti¬ 
mate  the  local  convection  over  the  ship,  each  ship  facet  is  classified  as  either  in  tangential  or  separated  flow, 
with  separate  correlation  relations  (Nusselt  number  vs  Reynolds  number)  being  used  in  each  flow  regime. 
View-dependent  facet  radiance  is  determined  by  combining  emitted  and  reflected  components.  The  surface 
reflectance  is  modeled  by  a  multiparameter  Gaussian  bidirectional  reflectance  distribution  function  (BRDF) 
superimposed  on  a  diffuse  reflectance  component.  Many-order  diffuse  multibounce  terms  are  computed 
using  a  standard  “radiosity  approximation.”  A  single  specular  bounce  term  is  computed  and  added  to  the 
diffuse  result.  Plume  radiance  is  computed  using  an  empirical  ship  plume  flowfield  combined  with  NASA 
IR  band  emission  models  for  CO2,  H2O,  CO,  and  soot. 


PLUME 

RADIANCE 


Ship 

Radiance 


Fig.  2  —  Block  diagram  of  ShipIR  illustrating  submodels 
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DESCRIPTION  OF  THE  NATO  SIMVEX  TRIAL 

The  measurements  were  performed  at  the  Cape  Scott  test  facility  at  Oshome  Head  (near  Halifax), 
Canada.  The  test  was  conducted  from  6-21  September  2001.  This  includes  the  time  to  mount  and  disas¬ 
semble  the  trial  equipment.  As  previously  stated,  the  participating  countries  were  Canada,  Denmark,  France, 
Italy,  The  Netherlands,  Norway,  Poland,  and  the  United  States.  Figure  3  shows  the  facility  with  all  the 
different  measurement  teams  in  position. 

Each  country  (except  Canada)  contributed  different  IR  cameras  for  the  measurement.  Canada  contrib¬ 
uted  the  test  site  and  the  ship  to  be  measured;  the  ship  used  was  the  CFAV  Quest  (Fig.  4),  which  is  operated 
by  DRDC  for  various  acoustic  and  oceanographic  studies.  Canada  equipped  the  ship  with  a  meteorology 
station  and  approximately  140  sensors  for  ship  surface  temperature  measurements.  Several  additional  ther¬ 
mocouples  were  mounted  on  the  ship’s  exhaust  uptakes,  and  a  rented  gas  analyzer  was  used  to  measure  the 
plume  constituents.  Norway  provided  a  Global  Positioning  System  (GPS)  capable  of  transmitting  the  ship 
position  to  the  shore  site  and  a  shore-based  weather  station.  At  the  shore  site,  the  ship  position  was  distrib¬ 
uted  to  all  measurement  stations  through  the  local  area  network  at  Osborne  Head. 

A  total  of  40  runs  were  executed  during  the  trial:  four  radiometric  accuracy  runs,  five  plume-only  runs, 
one  DRDC  panel  run,  and  30  full-ship  runs.  For  the  five  plume  runs,  the  Quest  was  configured  to  sail  at 
different  power  settings  for  the  diesel  engines:  single  engine  at  50%  power,  single  engine  at  100%  power, 
and  two  engines  at  100%  power.  The  two-engine  runs  were  designed  to  test  the  accuracy  of  the  blending  in 
the  plume  rendering  algorithm. 

Four  different  full-ship  runs  were  performed  during  the  trial.  The  four  full-ship  run  types  were:  Type  A 
-  heading  270°,  measure  shaded  starboard  side;  Type  B  -  heading  360°,  measure  sunlit  port  side;  Type  C  - 
heading  032°,  measure  sunlit  port  side;  and  Type  D  -  heading  032°,  measure  port  side  at  night.  Of  the  30  full- 
ship  runs,  there  were  four  Type  A,  five  Type  B,  eight  Type  C,  and  13  Type  D.  The  specific  headings  were 
determined  by  the  local  shore  geometry  and  solar  elevation/azimuth  angles  (Fig.  5).  D  runs  were  performed 
at  night  along  the  same  heading  as  the  C  runs. 


Fig.  3  —  Test  site  at  Osborne  Head,  Canada 
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Fig.  4  —  Test  ship  CFAV  Quest 


Fig.  5  —  Test  site  (NESTRA)  and  run  Types  A,  B,  and  C 
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For  all  full-ship  runs,  the  ship  sailed  with  a  constant  speed  and  heading  for  30  minutes  prior  to  measure¬ 
ment.  The  measurements  were  made  at  the  point  of  closest  approach.  This  point  is  on  a  1-km  arc  from  the 
measurement  station  and  is  marked  on  the  map  in  Fig.  5.  A  constant  speed  of  10  kts  was  used,  which 
required  the  ship  to  start  5  nmi  from  the  point  of  closest  approach.  This  allowed  the  ship  to  reach  thermal 
equilibrium  before  each  measurement,  which  is  an  important  criterion  for  the  validation  of  ShipIR. 

After  the  second  day  of  ship  runs,  the  U.S.  team  installed  their  radiometers  in  a  commercial  helicopter 
and  began  performing  both  plume  and  full-ship  runs  from  the  airborne  platform.  This  enabled  the  measure¬ 
ment  of  more  aspect  angles  for  the  full-ship  runs. 

INSTRUMENTATION 

Several  types  of  instruments  were  involved  in  the  trial:  meteorological,  temperature  measurement,  ex¬ 
haust  gas  measurement,  and  infrared  radiometric  (imaging  radiometers  and  a  spectroradiometer).  Since  this 
trial  was  conducted  to  validate  an  infrared  signature  model,  the  primary  instruments  were  the  IR  imaging 
radiometers.  Table  1  lists  three  of  these  instruments.  Spectral  response,  extensive  calibrations,  and  error 
analyses  were  performed  on  each  system.  Measurement  accuracy  for  each  instrument  was  determined  through 
pre-trial  joint  calibration/accuracy  tests  and  post-trial  error  analyses  [3,  4]. 


Table  1  —  Primary  Infrared  Instrumentation 


Country 

Instrument 

Image  Size 

Band  (pm) 

Accuracy  (%) 

Norway 

Inframetrics  MilCam 

256  X  256 

3.4-5.05 

11 

U.S. 

Indigo  Merlin 

320  X  240 

3.4-5.0 

9 

U.S. 

Agema  880  LWB 

140  X  140 

8.0-11.5 

8 

VALIDATION  ANALYSIS  METHODOLOGY 

Many  of  the  countries  have  previously  performed  validation  studies  of  ShipIR  using  their  own  domestic 
ships.  Lessons  learned  from  these  many  previous  trials,  as  well  as  methodological  procedures  developed  by 
NRL  [5],  were  used  in  designing  this  trial. 

The  overall  objective  of  this  validation  effort  is  to  quantify  the  IR  signature  prediction  accuracy  of  the 
ShipIR  model.  Measured  signature  values  of  the  Quest  were  compared  to  predicted  signature  values,  using 
the  appropriate  ship  operational  and  environmental  parameters  for  each  run.  Several  methodological  prin¬ 
ciples  were  used  that  distinguished  this  study  from  previous  efforts. 

•  High-fidelity  ship  representation:  The  geometrical  representation  of  the  Quest  was  composed  of 
approximately  6400  facets  and  1400  isothermal  plates,  which  is  greater  detail  than  had  been  used  in 
previous  validation  studies.  A  total  of  13  different  radiative  materials  were  modeled  (different  paints, 
windows,  canvas,  etc.),  and  detailed  reflectance  measurements  were  made  of  witness  samples  of  all 
major  materials. 

•  Error  diagnosis:  Additional  data  were  collected  on  parameters  that  were  neither  inputs  nor  outputs  to 
the  simulation.  Ship  surface  temperature,  direct  solar  irradiance,  and  absolute  sky/sea  radiance  mea¬ 
surements  were  made.  These  additional  data  enable  diagnosis  of  the  source  of  prediction  error  at  the 
submodel  level.  Such  information  is  critical  in  determining  which  part  of  the  model  to  improve  to 
yield  better  prediction  accuracy  for  future  releases. 

•  IR  radiometric  accuracy  trials:  Before  the  trial,  all  measurement  teams  performed  measurements  on 
a  4  X  4-ft  test  panel  of  known  temperature  and  emissivity.  This  enabled  all  measurement  teams  to 
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estimate  their  measurement  accuracy  and  improve  calibration,  data  collection,  and  data  reduction 
procedures  as  necessary. 

•  Accurate  and  comprehensive  measurements  of  input  data:  Meteorological  measurements  were  made 
from  the  shore,  the  ship,  and  from  a  buoy.  In  addition,  nearby  weather  balloon  measurements  were 
used  to  model  the  proper  vertical  profile  of  the  atmosphere. 

The  concept  of  “experimental  precision”  [6]  combines  the  last  two  items:  measurement  accuracy  of 
model  outputs  and  inputs.  The  precision  of  the  experiment,  for  purposes  of  validation,  is  the  root-sum-of- 
squares  (RSS)  sum  of  the  measurement  accuracy  of  the  model  output  and  the  uncertainty  of  model  output 
caused  by  errors  in  all  of  the  inputs  (derived  via  sensitivity  analysis).  This  precision  represents  a  lower  limit 
as  to  how  accurate  a  model  can  be  shown  to  be  by  using  the  results  of  the  validation  experiment.  For  this 
trial,  the  approximate  level  of  experimental  precision  is  15-20%  for  daytime  runs  and  20-25%  for  nighttime 
runs. 

Since  ShipIR  models  only  0%  and  100%  cloud  cover,  all  partial  cloud  cover  runs  (non-plume)  were 
excluded  from  the  validation  analysis.  Thus,  for  validation  of  the  full-ship  model,  17  runs  were  available  for 
analysis:  four  Type  A,  two  Type  B,  four  Type  C,  and  seven  Type  D. 

Temperature  and  IR  radiant  intensity  comparisons  were  made  by  both  Norway  and  the  United  States. 

VALIDATION  RESULTS 

Norway’s  analysis  focuses  on  V2.9,  MWIR  band,  and  clear-sky  runs  for  both  day  and  night  [7].  Tem¬ 
perature  analyses  were  performed  for  nine  runs,  and  IR  analyses  were  performed  for  10  runs.  Norway 
performed  spectral  measurements  during  the  plume  runs  (and  also  made  spectral  measurements  of  the  ship 
and  background);  these  results  will  be  presented  in  a  separate  paper  [8].  The  U.S.  team’s  analysis  focused  on 
V3.0,  both  MWIR  and  LWIR  bands,  and  daytime  runs  (both  clear  and  cloudy).  The  U.S.  team  was  not  able 
to  make  nighttime  measurements  because  the  helicopter  could  fly  only  during  the  day.  The  only  substantive 
difference  between  V2.9  and  V3.0  is  improvements  made  to  the  plume  emission  model.  Since  the  plume 
accounted  for  approximately  1%  of  the  full-ship  intensity,  comparisons  of  full-ship  results  between  the  two 
versions  are  valid. 

Norway  Results 

Figure  6  compares  ship  surface  temperature.  The  runs  are  grouped  into  day  runs  (8,  14,  19,  and  32)  and 
night  runs  (15,  16,  20,  21,  and  34).  For  the  combined  set  of  day  and  night  runs,  the  overall  root-mean-square 
(RMS)  temperature  prediction  error  is  2.6  °C.  These  results  indicate  a  clear  pattern  that  the  model  overpredicts 
during  the  day  (average  of  -1-1.8  °C)  and  underpredicts  at  night  (average  of  3.0  °C). 

Figure  7  shows  an  analogous  comparison  of  IR  contrast  intensity;  the  day  runs  were  overpredicted  (by 
36%)  and  the  night  runs  were  underpredicted  (by  63%).  While  the  day  runs  indicate  a  reasonable  predictive 
capability  of  the  model,  the  night  runs  clearly  illustrate  significant  modeling  errors.  One  might  expect  large 
percentage  errors  for  the  case  where  a  small  contrast  is  the  result  of  the  difference  of  two  radiance  values 
very  close  to  each  other.  Analysis  of  the  nighttime  measured  data  reveals  that  the  average  contrast  radiance 
difference  was  8  pW/cm^/sr,  which  is  equivalent  to  an  effective  temperature  difference  of  about  1  °C.  There¬ 
fore,  to  achieve  a  50%  prediction  error  for  “effective  contrast  temperature,”  a  prediction  error  of  0.5  °C  is 
needed  for  both  target  and  background.  This  is  quite  challenging  to  achieve. 


ShipIR  Validation  Using  NATO  SIMVEX  Results 


1 


o 


Measured 

Predicted 


8  14  19  32  15  16  20  21  34 

Run 

Fig.  6  —  Predicted  vs  measured  hull  temperatures  from  Norway  analysis 
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Fig.  7  —  Predicted  vs  measured  MWIR  intensity  from  Norway  analysis 


For  the  case  of  the  SIMVEX  night  runs,  a  sensitivity  analysis  was  performed  to  obtain  an  estimate  of 
“experimental  precision.”  This  indicated  that  the  predicted  signature  was  very  sensitive  to  whether  shore- 
hased  or  ship-hased  meteorological  data  were  used  as  input.  Thus,  the  experimental  precision  of  the  night 
runs  was  significantly  worse  than  that  of  the  day  runs 

United  States  Results 

As  previously  stated,  the  U.S.  analysis  focused  on  daytime  runs.  Most  of  these  measurements  were 
made  from  a  helicopter,  which  enabled  collection  of  data  from  all  four  cardinal  aspects  of  the  ship  (bow, 
starboard,  stem,  and  port).  Also,  these  data  were  taken  at  a  higher  elevation  angle,  typically  2  deg,  as  com¬ 
pared  to  1.4  deg  from  the  shore  site. 

Figure  8  shows  prediction  error  of  surface  temperature,  using  thermocouple  data  from  bow,  starboard, 
stern,  and  port  facets.  The  RMS  temperature  prediction  error  for  this  dataset  is  3.0  °C.  For  each  run,  the 
relative  wind  was  computed  and  each  side  of  the  ship  was  categorized  as  to  whether  it  was  in  stagnation, 
tangential,  or  separated  convection  flow.  The  difference  between  predicted  and  measured  temperature  is 
plotted,  grouped  by  flow  type.  Mean  and  standard  deviations  are  overlaid  for  illustrative  purposes.  These 
data  show  that  the  current  convection  model  works  relatively  well  for  tangential  flow,  but  overestimates 
temperature  for  both  stagnation  and  separated  flows.  Currently,  the  convection  algorithm  models  the  stagna¬ 
tion  case  as  though  it  were  tangential.  For  all  these  data  points,  the  air  temperature  was  less  than  the  pre¬ 
dicted  ship  surface  temperature.  This  indicates  that  convection  is  being  underestimated  for  these  two  flow 
regimes.  The  possibility  of  radiative  and  conductive  errors  was  eliminated  by  appropriate  analysis. 
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Fig.  8 


Prediction  error  of  surface  temperature 
as  partitioned  by  flow  regime 


Figure  9  shows  an  overlay  plot  of  measured  and  predicted  ship  signatures  in  both  MWIR  and  LWIR 
hands.  All  of  these  points  are  day  runs:  clear  skies  for  cases  1-14,  and  overcast  skies  for  cases  15-18.  With 
the  exception  of  the  first  two  points  (which  were  broadside  aspects  measured  from  shore),  the  points  are  in 
groups  of  four:  four  runs  with  four  measured  aspects  per  run.  The  overall  prediction  accuracy  is  34%  in  the 
MWIR  band  and  18%  in  the  LWIR  band. 

The  LWIR  results  are  within  the  precision  of  the  experiment  for  both  clear  and  overcast  skies.  There¬ 
fore,  the  model  is  essentially  as  good  as  the  measurements  (with  the  exception  of  cases  1,  2,  and  10,  which 
we  believe  are  due  to  temperature  underestimation).  The  MWIR  results  also  suffer  from  temperature  under¬ 
estimation  problems  (cases  1,  2,  and  10)  but  also  show  significant  model  underestimation  for  cases  4,  8,  and 
12.  All  of  these  cases  correspond  to  the  shaded  broadside  aspect  of  the  ship,  measured  under  clear  skies. 
Subsequent  analysis  of  the  thermocouple  time  histories  indicate  that  for  these  runs,  the  shaded  side  of  the 
ship  was  not  in  thermal  equilibrium  when  measured  [9].  This  indicates  a  flaw  in  the  design  of  the  validation 
trial  for  shaded  aspects  of  the  ship,  and  is  not  indicative  of  poor  model  predictive  capability.  Figure  10  shows 
representative  measured  and  predicted  MWIR  images. 
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Fig.  9  —  Predicted  vs  measured  ship  intensity  from  U.S.  analysis 
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Fig.  10  —  MWIR  ship  images 


IMPLICATIONS  FOR  FUTURE  MODEL  UPGRADES 

Based  on  these  two  datasets/analyses,  several  conclusions  can  be  drawn.  LWIR  daytime  prediction 
accuracy  is  within  the  experimental  precision,  given  measurement  accuracy  and  sensitivity  to  uncertainties 
in  inputs.  Where  the  two  analyses  overlap  (MWIR  daytime),  the  results  are  consistent  and  indicate  a  predic¬ 
tion  accuracy  in  the  35%  range.  While  not  as  good  as  the  LWIR  band,  this  is  still  adequate  for  most  applica¬ 
tions.  Nighttime  MWIR  prediction  accuracy  is  on  the  order  of  60-65%.  Although  the  experimental  precision 
for  the  night  runs  is  quite  poor,  there  are  undoubtedly  significant  prediction  errors. 

Subsequent  analysis  indicates  that  the  majority  of  the  observed  prediction  error  can  be  accounted  for  by 
errors  in  ship  surface  temperature  prediction.  The  Norwegian  FFI  dataset  indicates  that  the  heat  transfer 
model  may  be  underestimating  convection  for  both  day  and  night.  The  NRL  temperature  dataset  shows  that, 
during  the  day,  the  temperature  error  depends  on  the  flow  conditions  at  the  facet  in  question.  NRL  has 
performed  subsequent  research  into  better  Nusselt  number  correlation  equations  for  stagnation  and  sepa¬ 
rated  flows  for  incorporation  into  Version  3. 1  of  the  model.  These  new  correlations  will  result  in  generally 
higher  levels  of  convection,  which  will  tend  to  lower  daytime  temperatures  and  raise  nighttime  temperatures 
(since  the  air  temperature  at  night  is  often  above  the  predicted  ship  facet  temperature). 

Also,  an  analysis  of  the  FFI  night  runs  indicate  that  for  four  of  these  runs  (20,  21,  26,  and  27)  the  ShipIR 
heat  transfer  model  predicts  surface  temperatures  that  are  below  the  dewpoint,  which  is  not  physically  rea¬ 
sonable.  This  is  because  condensation  is  not  included  in  the  current  model.  Version  3.1  will  incorporate  film 
condensation  effects  [10]  into  the  heat  transfer  model.  This  modification  will  tend  to  increase  nighttime 
temperatures  when  condensation  is  a  factor  (high  dewpoint  and  net  radiative  cooling).  Both  of  these  up¬ 
grades  to  the  heat  transfer  model  should  result  in  better  prediction  accuracy  for  this  dataset. 

CONCLUSIONS/SUMMARY 

An  IR  field  trial  has  been  conducted  by  a  NATO  science  panel  on  IR  ship  signatures,  TG-16.  This  trial 
was  planned,  designed,  and  executed  specifically  to  validate  predictive  IR  ship  signature  models.  The  de¬ 
tails  of  the  trial  were  dictated  by  a  thoughtful  validation  methodology  that  exploits  the  concept  of  experi¬ 
mental  precision. 

Two  governmental  defense  laboratories,  the  Norwegian  Defence  Research  Establishment  and  the  U.S. 
Naval  Research  Laboratory,  have  used  these  trial  data  to  perform  a  validation  analysis  on  the  ShipIR  IR 
signature  code.  This  analysis  quantifies  prediction  accuracy  for  the  current  versions  of  the  code  and  identi¬ 
fies  specific  portions  of  the  code  that  need  to  be  upgraded  to  improve  prediction  accuracy. 
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The  prediction  accuracy  in  the  LWIR  is  quite  good  and  is  of  similar  magnitude  as  the  experimental 
precision.  In  the  MWIR,  the  model  tends  to  overpredict  during  the  day  and  underpredict  at  night.  The  cause 
of  this  has  heen  traced  to  the  heat  transfer  model,  and  specific  upgrades  have  heen  identified  that  will  result 
in  improved  prediction  accuracy. 
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